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Abstract. The analytic properties of the Markov operator as- 
sociated to a random walk are common tools in the study of the 
behaviour and some probabilistic features related to the walk. In 
this paper we consider a class of Markov operators which gener- 
alizes the class of compact Markov operators and we study some 
probabilistic properties of the associated random walk. 



1. Basic definitions 

Let (X, P) be an irreducible, random walk on the state space X 
which is at most countable. We suppose that the (usually infinite) sto- 
chastic matrix P describes a Markov chain {Z n } n( zfq defined on a prob- 
ability space (fl, J 7 , P) with transition probabilities p(x, y) := P[Z n+1 = 
y\Z n = x] homogeneous in time. Besides we consider the n-step transi- 
tion probabilities {p( n '(x, y)} x ,yex which represent the stochastic ma- 
trix associated to the n-th convolution power of P. 

The Markov operator associated to the random walk is defined as 
follows 

D(P) :=lf:X^R:^2p(x )y )\f(y)\<+OQ, Wx G X \ , 
I yex J 



(1) 



(Pf)(x) := £>(x,y)/(y), V/ G D(P), Vx G X; 

yex 



note that T>(P) D l°°(X) and that -P|;o°(x) is a bounded linear operator 
from l°°(X) into itself. 
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To explore the behaviour of the random walk (A, P) and its main 
properties we introduce the two generating functions 

oo oo 

G(x,y\z) = F(x,y\z) = ^/W(x,y)z n 

n=0 n=0 

where {f^ n \x, y)} x ,yex are the first time return probabilities, namely 

f( n \x, y) = F(Z n =y,Z i ^y,Vi = l,...n-l\Z = x), f®(x, y) = 0. 

Both the generating functions must be considered inside their circle of 
convergence in C. 

An irreducible random walk (A, P) is called transient if and only if 
there exists for any) x G X such that F(x, x) < 1 and recurrent 
otherwise. Among the recurrent random walks we distinguish the class 
of positive recurrent and null recurrent depending on whether f x : = 
J2^=i n f { x t x ) < +°° f° r some for any) x G A or not. 

We note that positive recurrence is a strong assumption: for instance 
if (A, P) is the simple random walk on a infinite, locally finite, non- 
oriented, connected graph (A, E), then it is not positive recurrent. 
Indeed it is easily reversible with reversibility measure given by m(x) : = 
4^{y '■ {x, y) G E}, which is clearly infinite. According to Theorem 
1.18 of P, if an irreducible Markov chain is recurrent, then it admits a 
unique (up to multiplication) stationary measure and this one is finite if 
and only if the walk is positive recurrent. Since a reversibility measure 
is stationary, if the walk were positive recurrent, then m should be 
finite. 

The importance of this class of random walks is highlighted by The- 
orem 1.18 of |T] (see also Theorem 3.2 of [2 ). 

Remark 1.1. We note that (X,P) is positive recurrent if and only if 
there exists for all) x G A , 

1 — Fix, x\z) 
hm — — — < +oo. 

z->l- 1 — Z 

Just take in mind that the limit always exists (finite or infinite) due to 
the decomposition 

1 — F(x,x\z) , 1—F(x,x\l) , F(x,x\l) — F(x,x\z) 
hm — — — = hm v — ' + hm v — ' , 

z-t-l- I — Z z-*l~ 1 — Z I — Z 

and, using well-known arguments, we have 
V nf( n \x,x) = lim V nf (n \x, x)z n 



n=0 n=Q 



lim F'(x,x\z) = lim 



F(x, x\l) — F(x, x\z) 



1- z-*l- 1 — Z 
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(note that the last equality holds also if the limit is +00). 

2. Compact Markov operators 

In this section we want to study the behaviour of a random walk 
whose associated Markov operator satisfying equation (j2J) below. In 
particular we study compact Markov operators. 

We recall here the characterization of a compact operator (with non- 
negative matrix elements) defined by equation ([T} (see |2J, Theorem 
2.2). 

Theorem 2.1. Let X be a countable set and let P be a transition 
operator on X with non negative elements, satisfying the condition 
sup x£X J2 y ex P( x ^y) < +°°- Then P is a bounded, linear operator 
from l°°(X) into itself; moreover P : l°° f— > l°° is compact if and only 
if for any given e > there exists a finite subset A e C X such that 

The next Theorem is the main result of this section: its corollary 
enhances Proposition 2.3 of [2]. 

Theorem 2.2. Let (X, P) be an irreducible Markov chain, and suppose 
that there exists e G (0, 1) and a finite subset A G X such that 

(2) sup ^2 p( x iv) < e ; 

X&X yeX\A 

then (X, P) is positive recurrent. 

Before looking at the proof, we want to understand what equation 
(J2J) implies from the point of view of the walker. 
Let us consider the preadjoint map P* : l x {X) — > ^(X) acting as 

p*v(v) = vP{y) ■■= ^2 u ( x )p( x i 2/)' e x - 

This is a mass-preserving map, indeed Yliyex v P{v) = J2 x ex u ( x )' 
moreover v > implies P*v > 0. If v is the probability distribu- 
tion of the position of the walker at a certain time, then P*v is the 
probability distribution after one step. 

In term of this evolution map, equation (J2J is equivalent to the exis- 
tence of a finite subset A such that, given any probability distribution 
u, the probability distribution after one step satisfies P*u(A) > 1 — e 
(or, equivalently, P™v(A) > 1 — e for any n G W). 
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Since from the Law of large numbers, for any given i6l, P-a.c. 

1 JO in the transiente or null-recurrent case 

lim — > li x \(Z n ) = < 1 
n-»+oo n ^--j ' I = in the positive recurrent case 

and since in the positive recurrent case, 1/t x represents the unique 
stationary probability measure (see [3], Section 1.7, Theorem 1), hence 
the walker will pass (asymptotically) at least 1 — e of its time in A. 

Proof, (of Theorem \2.ty) . Let A and e satisfying equation (J2J). 
Let us note that for any given iGlwe have 

sup P in) ( x iV) < e > 
xeX v ex\A 

indeed for any given n G M* 

F(Z n G A\Z = x) = J2nZ n e A|Z n _! = 2)P(Z^i = z\Z = x)> 1-e. 

Let Xq G X \ A be fixed and rewrite the previous equation as 
^p (n) (x ,x) > 1 -e, Vn G N*. 

This implies 



J2G(x ,x\z)>(l-e)lJ2 

xeA \i=i 



Since G(x, = 5 X „+F(x, y\z)G(y, y\z) = 5 xy +F(x, y\z)/{l-F{y, y\z)), 
the previous inequality becomes 



F(x ,x\z) z(1 - e) 



F(x,x\z) 

xeA 

Now, taking in mind the usual position l/oo = 0, since A is finite, 

< 1 - e < lim V C 1 -4F(so,sk) = y- i^o^ll) 

~ z ^~xTa 1-F(x,x\z) ^ A ^z-,i-(i-F(x,x\z))/{l-z) 

This easily implies the existence of x\ G A such that 

1 - F(x 1 ,x 1 \z) 

lim < +oo 

z-»i- 1 — 2 

hence, by Remark II .11 (X, P) is positive recurrent. □ 

Corollary 2.3. Lei (X, P) be an irreducible Markov chain, such that 
P is compact; then (X, P) is positive recurrent. 
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We emphasize that the Markov operator associated to a positive re- 
current random walk needs not to be compact as the following example 
shows. Take X = N and define the transition probabilities as follows: 




1 



P, 



\/n G W, 
\/n G N, 
otherwise, 



where p G (0, 1). The first time return probabilities generator function 
F can be easily calculated for x = y = as 



F(0,0\z) 



2pz 2 



1 + 



Az 2 p(l — p) 



the corresponding random walk is transient if p G (0, 1/2), null recur- 
rent if p = 1/2 and positive recurrent if p G (1/2, 1), but equation (J2J) 
does not hold, hence the Markov operator is always non compact. 



3. Some estimates 

Let us define the time of the first return ont the vertex x G X as 
T x := inf{n > 1 : Z n = x}; in the recurrent case we have 

t x = K[T x \Zq — x] — lim — — — = lim (1 — z)G(x,x\z). 

z— +1 _ 1 — Z z^l~ 

Moreover if equation (J2J holds, we have that F(x, y) = 1 for any x, y G 
X and 



which implies 



1 > > — > 1-e 



_ card(A) 

mmr x < . 

x£A 1 — e 

Besides for the first time entrance in A, Ta '■= inf{n > : Z n G A}, 
the following hold 

F(T A > n\Z = x) < e n -\ E[T A \Z = x] < 



In the reversible case, it is possible to find lower bounds for the n- 
step transition probabilities p^ (x, x) and their generating function. In 
this case the reversibility measure m satisfies m(x) oc l/r x . 
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Lemma 3.1. Let (X,P) be a reversible random walk, m a reversibility 
measure and x G V a fixed vertex. If there exists n G N* and A C X 
such that 

yeX\A 

then 



m(A) 

The easy proof of this lemma is straightforward and we omit it. By 
using this result one see immediately that, for any x G A 

G(x,x\z)> (1 - e l 2m( ;% ze[0,l). 
1 — z l m\A) 
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